In this paper we discuss the application of online surveys to the field of image quality. We examine an online survey technique that measures the subject's response time, in particular the time it takes for the subject to identify which of two otherwise identical images contains an image defect. The efficiency and accuracy of the results will be discussed for a case where subjects are asked to identify defects known as graininess and mottle in photographs with a varying amount of "quiet regions".